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ABSTRACT 

An instrunenr vas constructed to ueasure changes in 
teacher attitudes and beliefs resultimg fro« training in the teaching 
of the Elementary Science Study (ESS) program. The ftO-iteu, Likert 
type instrusent vas administered to a group of 22 elementary teachers 
attending a three-veek Bational Science Foundation sauaer institute, 
on the first morning of their attendance and again on the last 
afternoon. Analyses of the data revealed that no items shbved 
signific^tnt change in the non- preferred direction anS that the means 
of 21 of the HO items had changed significantly in the preferred 
direction. Of those items shoving no significant change, most were 
high on the pretests Analysis by subject revealed that 14 subjects 
shaved, significant change in the preferred direction, one shaved 
significant change in the unpreferred direction, and seven subjects 
shoved no significant change. The instcament developed is included in 
the document.. (CS) 



^ Documents acguired by EBIC include many informal unpublished 
• materials not available fro« other sources. EBIC makes every effort 
^ to obtain the best copy available. Vevertheless, items of marginal 
^ reproducibility are often encouttterei and this af fapts the guality 
^ of the microfiche and hardcopy i^eproSuctioas EBIC makes available 
^ via the EBIC Document Beproduction Service (EDBS)« BDBS is aot 
^ responsible for the guality of the original document. Beproductlons 
e supplied by EDBS are the best that can be made from the original. 
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belWs about teaching science 

Evaluation of teacher education presents many problezss, especi- 
ally ia prograins whose philosophies denand radical restructuring of 
teacher behavior. Direct observation of teacher behavior change, 
although desirable, is e:q>ensive and difficult. Often, the only 
poetical Tfieans of assessisent is the use of some instruznent that 
^./can be applied economically during the physical presence of teachers 
at the training site. 

While cany, studies have been reported in which change in gen- 
eral beliefs or attitudes was a parameter, investigators soaetiTaes 
find that pre-existing instruments are not sufficiently sensitive 
to the specific goals of the training program to. be studied* For 
this reason. Good (1971) developed a beliefs instrument to assess 
the particular prograa with which he was involved. The utility of 
Good* 8 instrument for assessing other programs has been reported 
CStrawitz, 1975, 1976), This author also used Good's instruaent 
in connection with an inservlce extension course on the Elementary 
Science Study (ESS) program* While the overall results were promi- 
sing, the number of individual items showing significant positive 
change was not as high as that reported by Good* It seemed likely 
that much of this disparity could be accounted for by the differences 
between the goals of the program tor whf i Good's instrument was 
developed and the goals of the program assessed by the present author. 
This thought led to the development of the Beliefs About Science 
Te«U!hlng (BAST) Instrua^nt, which was based on the specific goals 
of an NSF Summer Institute for Inservlce tralnlmg in the ESS prograa. 
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The philosc^!^ whlcli underlies the ESS prograa may be ^iiarec- 

4 

I 

t^^rized as qalte different from that apparently forming the/ basis 

4 
4 

OX coasaon practice in elenentary schools. It requires a c^ceptuali- 
ration of the teacher's role which is often in direct conflict with 

i 

the perceived role iiaplicit in traditional teaching;, Hogdrs and 

i 

Voelker (1970> describe the role aspect of the ESS prograi: 



To teach ESS materials as intended demands a certaiitf view of 
teaching, of the learner, and of the learning process. The 
teacher's role in an ESS classroosn is one of ' consultant, guide, 
and catalyst. .•.For this reason, the teacher must pee the 
child as having an extraordinary capacity for leatn^g and be- 
lieve that he learns best fron his own activity. (Those) who 
do not snare (this view) might be persuaded to reci^nceive their 
role as teachers through sensitivxtj^* training, worishp and 
reading. ' - . / • - 

4 

^ i 

The program developers (ESS Reader, 1970) feel th^t because children 

" I - / / 

are developmentally iizsnature, they must work out ideaW from concrete 



experience with materials. Ihey must haye a great deal of freedom 
to do their own structuring of the experience. The ^ognitive gains 
derived come from the child himself as he strives tpi understami 
and control the raaterials. When such imderstanding^and control is 
attained, it is accompanied by positive affect towajcd self, science, 
and learning. Because there is no general consensus on particular 
facts,, concepts, or principles of science that shciild be required 
at the elementary school level, ESS takes the vlej that the develop- 
xaent of logical thought proces|es and the concomj^ant positive affect 
should be the goals of an effective science progf'am« Implicit in 

4 
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these ideas is the belief that the pbys:^<^al world is accessible to 
discofvery and understanding,] not just bjr| authorities, but by anyone 
vho can observe and reason. 

DESCRIPTION OF THE ESS I^ISTITUTE 



The institute v/as held in suburbpii Los Angeles County during 
July of 1975. It lasted for three vffks and involved tweaty-tuo 
inservice teachers. The staff consisted of three Instructors and a 
i&aterlals preparation person. Several constiltants contributed addi- 
tional input anu technical assistande. The activities were mainly 
of three t3rpes: working as learners with science materials, teaching 
and analyzing mini-lessons done vptp children, and affective ex- 
ercises intended to develop Insight into the role of the teacher. 
Homework readings were assigned Mary Budd Rove's Teaching Sci- ^ 

ence as Continuous Inquiry Cl973jf/. Rove's ideas about fate control 
and wait time C1974' a, b,} were ppplled during many of the activities. 
For exanjple, each participant analyzed videotapes of her/his mini-lessons 
for wait time. The teaching-xaplng- analyzing activities began in 

the second week, and may have been an especially strong faxitor in 

■ .-It 
the restructuring of attitudes and beliefs. Durlnj the first week, 

vHen activities consisted mainly of work with science materials, the 

participants were relaxed and generally positive in attitude. They were 

/ " 

having a good time. When the teachlng-taplng-analyzlng activities / 

■/ ^ 

began» aa element of tension, perhaps even dissonance, was apparent. 
By the third week, nost of the participants had seemlsgly resolved 
tiielr tensions, and an atmosphere of accomplishment prevailed. 
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Based on the desc2^bed philosophy^ eight categories were extrac- 

/ 
/ 

ted» fron which forty Likert statements were devised: 
!• Who structures the activitie|s 

2. Authority vs. self as the source of science kncwljedge . 

3. Inrportance of working directly with icaterials 

4. Value and interest of science for children 

/ 

5. Evaluation of teaching and |Leaming 

6. Verbal interactions / 
?• Nature of science 

8« Required content of elcireiitary school science 

The categories were used only as stimuli for gemerating test 
Items. Ko attempt was made to develop independently ^interpretable 
subscalcs. It was attempted to word the statements in' a manner 
idilch would allow detection of subtle pre-post changes, rather than 
only marked changes in belief. The Idea was to Include statements 
to which teachers might change in their reaction, for exasq)le, from 
••strongly disagree" to "undecided." This could be Interpreted as 
becoming more open to the Idea expressed by the item. In other words, 
although there was a preferred direction of change for each Item, 
It should not be construed that makimum congruence with ESS goals 
requires a maylTmnn agreement (or dlsagreeirient,\dependlng on the 
direction) with each statement. 
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The first draft of the Instrument was administered to the other - 

two institute ^instructors. Items rated on the unpreferred side of ' 

■ ' - ' .. ^ . ■ ■ 

the scale and those regarded as acibiguous were revised. A copy of 

the version adsiinistered at the institute ic included at the end of 

the paper. ^' 

- The instrument was administered to the institut'e„participants 
orf the first morning before any instructional activities took place, 
and again on the last afternoon, three weeks later. To assure anonym- 
ity, a system of secret identification numbers was used. A* numbered 
sheet was circulated and the participants* signed their names next 
to any number they wished. This became each person's identification 
number to enter on,. the response sheet. . A volunteer participant held 
the list and brought it back on the final da^ so that each person 
could be reminded of her/his number to ente^ on the post-test response . 
sheet. A gr^at display was then made of -destroying the number sheet; 
At no time ijid anyone other than the participants have access to 
the sheet. This system preserved anonymity while permitting each 
subject's pre and post-tests to be matched, thus avoiding. possible 
mortality problems and allowing analysis by subject as well as by 
item. 

RESULTS 

Split-halves reliability calculated on the pretesiL data Kas 
0«'86. Content validity is claimed on the basis of item construction 
based on training objectives and expert ratings. Pre-post compjiri- 



sons of total scores using the t-test for related ceasxures showed! 

. . \ ' \ 

a change' in the preferred directions which was significant at. the 

.■ ■■ ■ •• . . ■ ■ . ■ 'v i ■ 

0*001 level. Criterion validity^ the extent to which trained sub- 

■ ' ■ : ■ ■ ■ ■■ • \ ■ [ 

jects score higher than ttntrained subjects, Is supported by this \ 

result. >^ ■ i I 

' \ . \ . \ 

The t-test on items shewed that the means of 20 of the 40 iteiisi 

\ ' ' \ 

had changed significantly (O* 05 level or better) in the preferred I 

direction* No items showed significant change in the unpref erred 

•* ^ ' " '1 

direction* Of those items shoving no significant change, jtaost were 

high on the pretest, suggesting that subjects held the congruent \ 

beliefs an those iteos before the institute began. IThen tne data J 

vere analyzed by subjects, 14 subjects (63* 6%) showed significant 

- I 

change in the preferred direction, one subject (4*5%) showed signifi- 
cant change in. the unpref erred direction, and seven subjects (31*8%) 
showed no significant change « 

CONCLUSIONS 

This instrument, the BAST, appears to have considerable promise 
in evaluating ESS teacher training programs, even though much work 
remains to be done. An important next step would be to study the 
relationship of measures with the BAST to subsequent directly ob- 
served teacher behavior* If such relationship could be established, 
it would support predictive validity, and greatly enhance the credi- 
bility and utility of the instrument* 

Since 1975, NSF Institutes have been in short supply, mcklng it 
impossible to test comparable groups* Several preseryl^e methods 

" ' . •• ■ 8 
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classes In which tlie ESS philosophy fonacd the strongest c^<^r^at^v . 
have been assessed, however. As V^&^t be expected for ^.evctJil rc*jtcn.'S» 
the ninsber of items re^jchlng significance was lers thi^n itt iU< L55 
institute group* ^T^al* pre-pcst change wan j^ulf Ic.-in: ii^ .thc ;;rr- 
ferred direction for every group, however. Itrt 4,t:wlv:.r; c:. ' 
data fron ail sources and feedback fren !:ubj< ct f.ub^rt t s*^ tc- j^^i r-:- 
testiSg.have fonned a basis for a second version of the iV*ST, TbS* 
second version is now being used with two cocparablc iMitho^ft ci^;a*4rA. 
one that involves ESS Ideas and one that doce r.ot. ^ 

The author twishes tc gratefully ackaovledj-e h*jr Jc^t to E^n^la 
"Good, whose original Ir^.^t rur.cnt j rcvlcli d th"- tr ^ cr^v. f : : t? :i , 
as veil as iievcral ite:rs used in tl e LJST. 



9 



-7- 



TABLE I 





T-TEST FOR RJ^LATED KEASURES- Oil PRE-f OST 


CEAKGE BY 


ITi^lS 




Item No» 


Preferred 
Direction* t 


T><** 


Item IIo. 


Preferred 
Direction 


* t 


P< . 


1. 


A 


1.317 




91 


D 


3.*'i61, 


.01 


2. 


D. 


1.804 




zz . 


A 


1.225 


KS' 


3. 


D 


3.637 


A 1 
. 01 


9^ 


D 


4.814 . 


.001 


4, 


-D 


0 




9A 


D 


0.718 


NS 


5. / 


D 


-1.703 ' 


vc 


9 

z^ . 


A 


0 


NS 


6. 


A 


2.109 


• U!> 


9A 
ZD . 


D 


2.794 


..02 


7. 


D 


12.090 


. UUl 


97 
Z / • 


D 


1.074 • 


KS 


8. 


A 


-1.571 


..to 


9P 
ZO . 


D 


0 


KS 


9. 


D 


2.2/,6 


. UI) 




D 


1.232 


i:s 


10. 


V 


-0.710 , 






A 


0.644 




11. 


D 


0.891 






D 


2.534 


.02 


12. 


A 


0.699 


rib 


*19 
JZ . 


D 


4.092 


.001 


13. 


D 


9.176 


.00. 


33. 


D 


4.414 


.001 




A 


' 2.308 


.05 


34. 


D 






15." 


A 


-1.225 


NS 


35. 


D 


9.925 


.001 


16. 


D 


2.451 


.05 


36. 


A 


4.284 


.001 


17. 


A 


2.630 


.02 


37. 


D 


2.326 


.05 


18. 


A 


2,217 


.05- 


38. 


A 


1.577 


NS 


19. 


D 


0 


NS 


39. 


,D 


2.246 


.05 


20. \ 


A 


0.419 


NS 


40. 


D 


2.235 


.05 



* A - toward "strongly agree." D - toward "strongly disagree." 
**p (for two-tailed test) 
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BELIEFS ABOUT SCIENCE TEACHING, VERSION 1 . . - . * 

1. A teacher can adequately evaluate children's progress in* science through 
informal observation during activities with niaterialsi ^ ^ 

2» Demonstrations of scien^tific principles to a class by a teacher are 
highly important to children. 

3« To see if their experinents came out correctly, children should be 
encouraged to dp library research. 

4. Most childrexriyho cannot read- at their grade level vould not be inter- 
* ested^^ science. 

5*^-^^nce society is basically competitive in nature, the use of letter 

grades should be used in science to be fair to the children in helping 
them prepare for the future. 

6. Elementary school science should focus on children's wbrk with concrete 
. objects and materials. 

7. The teacher should- positively reinforce those children vho are doing 
valuable things with their science materials in order to indirectly 
influence other children toward those goaJLs. 

8» Questioning authority is one of the important valuer of science. 

9* There are some things in elementairy school science that have to be learned 
whether ^^hey are interesting or not. 

XO^ It is not realistic to expect as much in science from children who are 
poor readers as from~those-wh()_arejBOod readers^^ / 

-S ■ ' ' ^ — ■ 



11. The teacher should Impress on the children how to behave when working 
with messy materials so that spills are avoided. 

12. Children who want to do some simple procedure overhand over again in. 
science should be allowed to do it. 

13. , Long pauses 'between teacher questions and pupil responses tend to cause. 

anxiety in children. 

14. Science topics such as atoms and molecules,. dinosaurs, or the solar 
system are less valuable .in elementary school than topics such as 
behavior of liqxiids, electricity, or worms. , . 

15. It is as important for children to ask questions in science as it is 
for them to give answers. 

16. When children work with science materials, they generally need some 
guidance in order to achieve significant learning. 
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34« In 0xdmt to Mnd«r«uuul what sciitnc« is all about* • child cm t^^in about 
as tsuch frcm teacher detaoostrationai readings and dlacuaaloti aa froat 
vt>rklag vlth vaterlals. 

35. To learn science is to learn the concepts and principles that have been 
identified tj icientlsts. 

36. A tescher wlio usually i^Tiftverg children's questions of fact or tfxplana- 
tloii In rci^nce im p»ub<«l*ly doing thcts a dlcccrvlcc^ 

37. Activities vlth sclcrcc r^itprials thauH be used as a rcvsrd for chlldran 
vbo work veil in their silence textbooks. 

38. CosBson objactif' are better tor children* a science activities than special- 
llxed etjuipnent because they link scienc.- to everyday life In the child's 
mind. 

39. Wltten tests are xieccsisry In science to find out If children have 

learned thv ccnccptu and principles studied in class. 

40» The teacher rurt ic*"ctire*. Inti rvisre tc prfvrrit rhildrrn fro^a dravJj£ 
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